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ABSTRACT 

Described is the final phase of a study directed at 
the development of an on-the-job training (OJT) costing methodology. 
Utilizing a modification of survey techniques tested and evaluated 
during the previous phase, estimates were obtained for the cost of 
OJT for airman training from the 1-level (unskilled to the 3-level 
(semiskilled) in five category B Air Force specialties. The 
specialties studied were pavement maintenance, fire protection, food 
service, fuel service, and aaterial facilities. The cost per graduate 
of OJT for these specialties vas compared to the cost per graduate of 
resident school technical training. For three of the five 
specialties, OJT cost per graduate vas belov the technical training 
school cost per graduate. Supervisors were surveyed to determine if 
there was a difference in performance between OJT and technical 
school graduates in these AFS*c. As vas true in the previous phase, 
no evidence vas obtained to support the hypothesis that either OJT or 
technical school graduates vere superior in performance. Conditional 
cost models vere also formulated and tested. The conditional cost 
models are based on an alternative or opportunity cost concept and 
represent a refinement of the original cost models. (Author/BJG) 
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SECTION I 



INTRODUCTION 



This report discusses the results of the second phase of a two- 
phase research effort aimed at developing an On-the-Job Training 
(OJT) costing methodology and using the methodology to estimate the 
cost of OJT for a number of selected Air Force specialties. Results 
of the first phase (hereafter. Phase I), were published in a 
technical report entitled "The Development of a Methodology for 
Estimating the Cost of Air Force On-the-Job Training," AFHRL-TR-73- 
3^4. During Phase I, three alternative methodologies for estimating 
the cost of OJT were developed. All three utilized a survey approach 
and were applied simultaneously to a sample of airmen training from 
the l-level (helper) to the 3-level (semi-skilled) in the Administra- 
tive Specialty, AFSC 702X0. A preferred methodology was selected, and, 
using this methodology, an OJT cost estimate per graduate (702X0) was 
established. Also, an estimate of the cost of resident technical 
training to the 3-level (Course 3ABR70230 at Keesler AFB) was 
obtained. It was observed that the OJT cost per graduate for the 
Administrative Specialty was significantly below the resident 
Technical Training School (TTS) cost per graduate. It was also con- 
cluded that, in terms of performance as perceived by supervisors, 
both types of training resulted in approximately the same quality 
of graduate. 

The general approach taken in the Phase I study, as well as in 
this present study, was to utilize the OJT supervisor survey responses 
in cost models or equations to compute cost element or factor 
estimates. The cost elements considered included 

(1) Cost of trainee time spent in training 

(2) Cost of supervisor time devoted to training 

(3) Remedial training cost 
(k) Records management cost 

(5) Cost of delayed entry into training 

(6) Equipment and material costs, 

and the sum of these cost elements comprise the OJT cost per graduate. 
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For purposes of comparing OJT and TTS costs, adjustments to 
the TTS costs were made to reflect (I) the cost of training the 3- 
level TTS graduate (trainee cost only) to a level of proficiency 
equivalent to the OJT trained 3-level (TTS Equivalency Cost), and 
(2) the cost associated with the TTS graduate's delayed entry time 
into the work force due to such activities as personnel processing 
(TTS Delay Cost)- 

In the study reported here (Phase M of the overall research 
effort), the OJT costing methodology was applied to five additional 
AFSC's; the survey instruiDCnt and cost models were further refined; 
and the question of OJT instructor and trainee productivity was 
expl icitly investigated. 
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DESCRIPTION OF STUDY 

1. AIR FORCE SPECIALTIES SELECTED 

The five Air Force specialties studies in this research effort 
were all Category B skills. (Category 8 specialty trainees may 
upgrade from the 1 to the 3-level either by attending TTS or 
completing OJT) . The specialties studied were: 

AFSC 551X0 Pavements Maintenance Specialist 

AFSC 571X0 Fire Protection Specialist 

AFSC 622X0 Cook 

AFSC 631X0 Fuel Specialist 

AFSC 647X0 Material Facilities Specialist 

These specialties were selected to provide a wide range of skills, 
training environments, work intensities and locations. A brief 
description of the types of work activity performed in each of the 
specialties is provided in Appendix I. More detailed job descriptions 
appear in AFM 39-1 • 

2. SURVEY METHODOLOGY 

The overall study objective was to develop a methodology for 
collecting data necessary to develop cost estimates. In Phase I, 
three distinct methods for soliciting data by mail questionnaire 
were explored, and the most promising of these was utilized in 
Phase i I . 

To be specific the Phase II methodology drew heavily on (I) 
work sampling methodology based on self-recording (i.e., respondents 
were asked to record the actual hours spent by trainees and 
instructors on a daily basis for one week); and (2) the use of pre- 
existing recorded data in Air Force files on the duration of training. 
In addition, respondents were asked to provide their "'average 
experience" and best judgment on some aspects of training. This kind 
of question was limited, however, to areas where no other existing 
measures were obtainable; and the questions were aimed at aggregate 
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data rather than at small elements of activity on which judgments 
might be suspect. 

The specifics of the methodology with respect to sampling and 
roMow up are discussed below under Development and Admi nistration; 
and the survey instrument is in Appendix 1 1 . 

3. IDENTIFICATION OF COST ELEMENTS 

The cost elements investigated in Phase II were the same (with 
one exception— equipment and materialsras those utilized in the 
Phase I study and by Dunham (1972). They included: 

a. Trainee time spent in training 

b. Instructor time devoted to training 

c. Remedial training 

d. Records management 

e. Delayed entry to training 

f. TTS delayed entry 

g. TTS equivalency 

The two major elements of cost considered are the time of 
instructors and the time of trainees. To improve the accuracy of 
the estimated costs, these two elements have been broken down into 
several finer elements including the instructor time devoted to 
training and record keeping, the time the instructor and the 
trainee spent in remedial training (after a trainee has failed the 
Apprentice Knowledge Test or the Career Development Course (CDC), 
end of course exam), the time the trainee spends in training, and 
the time the trainee spends waiting to enter training. Record 
keeping, remedial training, and waiting are insignificant compared 
with either the cost of trainee or instructor time devoted to training 

CONDITIONAL COST MODELS 

In Phase I it was implicitly assumed that instructor time 
devoted to training is a 'VeaP' cost. In other words, if the instruc- 
tor was not conducting OJT, he would devote his time to some other 

^The cost of equipment and materials in Phase I represented .6* 
of the total OJT cost. 
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activity productive to the Air Force — specif ical ly, an activity 
otherwise being performed by someone else. Similarly, it was 
assumed that trainee time spent in training is a real cost. That is, 
if he were not being trained, he could be serving in some other 
capacity— perhaps at a lower skill level; and conversely that part of 
the time he spends at work, when he is not receiving training, is 
productive. 

In Phase II an attempt was made to examine the effects ot some 
of these assumptions explicitly. Each supervisor was asked (Appendix II, 
question 8) to indicate whether or not the number of his NCOS could 
be reduced, without a reduction in performance, if OJT were discon- 
tinued in his section. If he responded positively, he confirmed the 
assumption of Phase i. If he responded negatively, it was assumed that 
the NCO must be there anyway, that training is indeed an auxiliary 
activity, and that the elimination of training would not result in a 
decrement of costs. 

Each supervisor was also asked (Appendix II, question 12) if he 
could carry out the productive work of his section without any loss of 
effectiveness with no OJT trainees. If he responded positively, it was 
assumed that the trainees do not really contribute to productivity 
(although they may be doing make-work) and therefore trainee costs are 
not only the marginal cost of the trainees' time while receiving 
instructions, but rather the costs of all their time. If he responded 
negatively, it was assumed that the OJT trainees do contribute to pro- 
ductivity and that their productive time is not a real element of train- 
ing costs. 

These concepts are incorporated in "Conditional Models" which 
treated the costs of instructor time and trainee time as a function of 
the individual supervisor's responses to questions, 8 and 12. 

5. DEVELOPMENT AND ADMINISTRATION 

The original concept of this overall study Involved the exploration 
of three different methodologies in Phase I on a single AFSC and the 
application, in Phase 1 1 , of the best methodology to five other AFSC's. 
Although, in principle, the concept was followed, it was certainly modi- 
fied in the conduct of the lesearch. As was indicated in the Phase I 
report, the limited number of Administration specialists available for 
each sample made it important to combine all three methodologies in a 
single survey instrument, which was administered to each Administrative 
Supervisor. It also was a conclusion of the Phase I study that a 
"mixed methodology" asking different questions by different techniques. 
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and, in fact, developing certain data from other existing sources 
was the best strategy for Phase II. Thus, the Phase 11 methodology 
IS really a combination of a number of items tried out in Phase I 
rather than a simple selection and reappl icat ion of one aspect of 
Phase I . 



Finally, other modifications to improve the phrasing of ques- 
tions were also utilized in Phase II. Perhaps the best way to put 
It IS to say that Phase 11 simply represents another iteration in 
improving the methodological development of a survey technique for 
generating OJT costs. 

As in Phase I, the questionnaire was pilot-tested at the Air 
Force bases in the San Antonio area, including Lackland, Kelly, and 
Randolph; and some modifications were made to the phrasing of ques- 
tions as a result of these tryouts. (Additional modifications derived 
from Phase II results are also proposed later in this report). 

The sampling scheme was designed to achieve as wide a sample of 
bases as possible, and simultaneously to assure that no single base 
was overburdened with surveys. The original plan called for 100 
surveys from each AFSC, from 25 bases. After a listing of the number 
of airmen in OJT to the 3-level for each AFSC was prepared at the 
Air Force Human Resources Laboratory (AFHRL) at Lackland, it became 
apparent that this plan would not be successful since there were not 
enough airmen in training in three of the AFSC's. 

The final decision rule for selecting the bases and airmen to be 
surveyed was the following: 



Sample all available airmen in on-the-job 
training from the 1-to the 3-level at each 
CONUS Air Force base; however, no base 
shall receive more than 6 surveys in an 
AFSC. 



In aggregate, 527 surveys were sent to 76 bases. It was, however, 
only possible to send hj surveys in AFSC 55130, 53 in AFSC 57130, and 
58 in AFSC 6'»730. Supervisors in AFSC 62230 received 195 surveys and 
supervisors in AFSC 63130 received 17^. * 

Approximately one month after the surveys were sent, telephone 
follow-ups were made to all the bases which had not completely responded 
to the survey, and this was continued on a bi-weekly basis until every 
base had fully responded. 
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SECTION III 
RESULTS 



K RESPONSE 

228 usable surveys were returned in total— 30 in AFSC 55130, 
25 in AFSC 57130, 90 in AFSC 62230, 72 in AFSC 63130, and 11 in 
AFSC 64730. 

It should be emphasized that this does not represent a k3% 
response as might be concluded from the numbers at first glance. In 
general, it is more appropriate to describe the response as closer 
to a total Air Force population of those training situations 
available at the time the survey was made, rather than a fractional 
sample with a high non-response bias, (The one exception, perhaps, 
is for AFSC 64730 where the response was indeed very small). 

The tape files maintained on the population of trainees in 
OJT at each base quickly become out-of-date due to upgrading, trans- 
fers, discharges, etc. Thus, many of the bases returned unused 
surveys, indicating they had no trainees in the designated AFSC or 
had completed as many as there were trainees and were returning the 
balance. 

In AFSC 70230— the Administrative Specia 1 ty— studied in Phase I, 
most of the sections surveyed were small (averaging 7 people). Each 
supervisor typically had one or two trainees. (The average number 
of trainees in a section was 1.3). In Phase II, for the new AFSC^s, 
the average number of personnel in a section was 43 with 2.6 trainees 
to the 3- level. Since the population counts were based on trainees, 
but the surveys were directed to supervisors, there were over 60 
duplicate surveys submitted by supervisors of more than one trainee. 
On the principle that we are attempting to identify the cost of 
trainees in different training situations, rather than trainees, per 
se, duplicate surveys were not tabulated. 

All responses were reviewed and manually edited before they 
were keypunched for data processing. Despite considerable improve- 
ment of the instrument the edit procedure led to additional recom- 
mendations for question improvement. These suggestions for specific 
question modifications are presented after the actual survey 
instrument in Appendix IL Numerical results of the survey are 
presented in the next subsection. 
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2. SURVEY RESULTS 

The results across the AFSC^s are presented in Table 1. Tables 
11 through 15 in Appendix III contain the suinmary results, by AFSC, 
of the responses to the survey; questions are identified by number 
and a brief description. The complete questions can be found in the 
survey instrument, Appendix II. Appendix III also contains comments 
on many of the responses to specific questions. 

Tables 2 through 7 list the results of the Cost Estimating Rela- 
tionships or Models. Explicit definition of the models can be found 
in Appendix IV. There is at least one model for each of the seven 
cost elements previously identified and these correspond to the models 
util ized in Phase I . 

In addition, there are five new cost models which attempt to 
address the problem of capacity to train and the problem of whether 
the trainees are productive, when not engaged in the training activity. 
These last five models are called Conditional Models because the costs 
depend or are conditional upon answers given by the supervisor about 
productivity and capacity in his particular section. When costs are 
defined as the consequences of the choice between real alternatives 
(Fisher, 1971, P*^^), then the conditional models are improved estima- 
tors of cost because they depend on the real consequences that might 
result from changing the number of OJT trainees in any particular 
section. 

The following paragraphs present a brief discussion of each of 
the models (see Appendix IV also). 

Model 1 uses: (1) the estimate of duration of training derived 
from the AFHRL/Lackland files on historical data for trainees by 
AFSC, and (2) training time per trainee based on answers to question 
18. On the average. Model 1 shows the cost of trainee time at about 
$650. 

Model 2 uses the same estimate of training duration as Model 
1, and the time spent on training by the instructors for each AFSC 
is based on responses to question 20. Model 2 shows instructor time 
at about $866 on the average. 

Model 3 estimates the cost of typical delay in waiting to start 
3-level training and is based on the responses to question 2. Model 
A estimates the cost of remedial training and is based on the 
responses to question 11. Model 5 estimates the cost of records 
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TABLE I: SUMMARY OF RESPONSES TO QUESTIONS ALL AFSC'Sl 



\.\ 

I. 2 
2. 
3. 
k. 
5. 
6. 
7- 
8. 

9. 

10.1 
10.2 
10.3 
10. 

II. 1 
11.2 
11.3 
11. 
12. 

13. 



QUESTION 

Number Upgrading To 3 Level 
Number Upgrading To 5 Level 
Days Delay In Start To 3 Level 
Days Delay In Start To 5 Level 
Weeks, Proficiency To Award 
Week Of Tra ining 
Percent Of Training Completed 
Percent Of 3 Skill On Arrival 
Reduction in NCOs Possible Pet 
Record Keeping Hours 
Pet Of 3 Skill , Tech Scl Grad 
Additional Weeks To 3 Level 



Difference In Training 

OJT Superior 

Pet Failing ECT 

Weeks, Remedial Training 

Trainee Remedial Hours 

Instructor Remedial Hours 

Effective Without Trainees 

Trainee Hrs Productive 



Pet 
Pet 



Pet 



Wk 


Mean 


Std Dev 


N 


1 


15.52 


10.38 


206 


k 


19.57 


8.'»1 


206 


8 


2'».62 


7.27 


205 


12 


29.03 


7.77 


200 


16 


33.5'» 


8.3'» 


198 


20 


36.33 


7.50 


190 



\k. Number Of Personnel In Section 

15. More Trainees Possible 

16. More Trainees Without 5s 

17. Number of 3 Level Trainees 

18. Trainee Hrs Training Per Tmee 

19. Trainee Hrs Productive 
20.3 Instructor Hrs E3 

20. k Instructor Hrs E** 

20.5 Instructor Hrs E5 

20.6 Inst-uctor Hr3 E6 

20.7 Instructor Hrs E7 

20.8 Instructor Hrs E8 

20.9 Instructor Hrs E9 

20.10 Instructor Hrs GS5-GS9, Off 
Average Instructor Hrs/Trnee 
Average Grade Of Instructor 



MEAN 

2.59 

12.39 
11. '♦5 

5.89 
10.86 
57.09 
16. '♦5 

0.13 

2.19 
'♦0.9'* 

^♦.25 

0.60 

0.51 
18.60 
^♦.13 
8.51 
6.53 
0.36 

Trainee Hrs 



0 1 u utv 


M 


9 01 


217 


z • 


210 




225 






c ftl 


217 


-7 ft/l 


9nl 


2/ . /> 




1 ftft 


91 ^ 


n n? 


223 


1 7*^ 


223 


• H 1 


27k 


Z. 91 


91Q 




220 


f\ nil 


1 30 


22. '♦7 


199 


2. '♦I 


206 


C 71 




^.55 


203 


0.03 


225 


Hrs Instruction 





Mean 

20. '♦3 
15.38 
10.97 
6.'»6 
3.67 

i»2.78 
3.81 
2.12 
2.'»0 

12.91 
20.08 
9-38 
11.75 
10.86 

7.5'» 
k.Sk 

2.67 
2.50 
10.20 
12.18 
i».87 



Std Dev 
10.38 
8.1»1 
7.27 
7.77 
8.3^ 
7.50 



N 

206 
206 
205 
200 
198 
190 



27.76 
3.03 
2.61 
1 .80 
7.33 

10.38 
7.69 
9.69 

10.20 
6.35 
^♦.77 
1.15 
0.71 
9.30 

10.20 
0.95 



222 
222 
22'* 
205 
201 
176 
^♦5 
118 
]kk 
72 
18 
3 
2 

25 
190 
193 



^Note that question parts a, b, c, etc., are coded .1, .2, .3, etc, 

9 
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TABLE 2: COST ESTIMATING RELATIONSHIPS FOR AFSC 551 30 



MODEL 

1 Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

^ Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time 

11 Conditional Trainee Time 

12 Conditional Instructor Time 

1^ Conditional Remedial Training Time 

15 Conditional Records Mgt Time 

16 Conditional Tech School Equiv Time 



TABLE 3 



MODEL 

1 Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

k Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time 

11 Conditional Trainee Time 

12 Conditional Instructor Time 

H Conditional Remedial Training Time 

15 Conditional Records Mgt Time 

16 Conditional Tech School Equiv Time 



MEAN $ 


STD DEV $ 


N 




551*. 86 


22 


1 li'ii 


/9h.9'» 


20 


158.68 


97.95 


25 




'»5.'»9 


17 




30.'»'» 


20 


6i».19 


50.05 


19 


187.86 


130.1»5 


25 


1010. 10 


715.30 


22 


'»0.73 


203.67 


25 


13.81 


21.69 


21 


2.17 


10.86 


25 




67.77 


21 


FOR AFSC 


57130 




MEAN $ 


STD DEV $ 


N 


869.55 


'HI. 97 


27 


1 z5o. y\ 


1352.37 


27 


306.28 


189.22 


30 




33.25 


22 


IS. 25 


78.39 


27 


133.92 


I96.5'» 


25 


279.50 


216.72 


29 


161'».51 


88'».21 


29 


38i».10 


1290.00 


30 


10.07 


21.33 


25 


8.55 


25.36 


30 


1'»'».19 


211.22 


27 
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TABLE ^: COST ESTIMATING RELATIONSHIPS FOR AFSC 62230 



MODEL 

\ Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

k Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time 

n Conditional Trainee Time 

12 Conditional Instructor Time 

\k Conditional Remedial Training Time 

15 Conditional Records Mgt Time 

16 Conditional Tech School Equiv Time 



MEAN $ 


STD DEV $ 


N 


706.29 


1»I5.01 


81 


995.92 


7oH. 5h 


IS 


309.09 


213.27 


88 


hQ.\3 


39.77 


65 


107.22 


91.70 


71 


9'».87 


102.30 


66 


307.33 


228. '»2 


83 


1l»60.62 


1018.61 


86 




385.83 


86 


11. '♦2 


27.32 


79 


8.35 


'H.79 


85 


101.77 


130. 62 


77 



TABLE 5: COST ESTIMATING RELATIONSHIPS FOR AFSC 63130 



MODEL 

1 Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

k Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time 



11 

12 
14 
15 



Conditional 
Condit ional 
Conditional 
Cond it ional 



Trainee Time 
Instructor Time 
Remedial Training Time 
Records Mgt Time 



16 Conditional Tech School Equiv Time 



MEAN $ 

1»50.80 
533.98 
278.03 
51. '♦9 
59.00 

127.93 
2i»8.01 

662.90 

67.5'* 
16.58 
8.29 

91.08 



STD DEV $ 

282.69 

'»11.'»9 
235.76 
3'».0'» 
57.65 

125.31 
171.11 

456.18 
200.21 
32.14 
26.91 

108.78 



N 

60 
59 
72 
51 
59 

59 
67 

62 
70 
62 
70 

62 
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TABLE 6: COST ESTIMATING RELATIONSHIPS FOR AFSC Skj^Q 



MODEL 

1 Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

k Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time 

11 Conditional Trainee Time 

12 Conditional Instructor Time 

\k Conditional Remedial Training Time 

15 Conditional Records Mgt Time 

16 Conditional Tech School Equiv Time 





3 10 DEV $ 


N 




^♦57. 90 


11 


997.19 


^♦99. 63 


II 




^03.21 


1 1 


30.15 


I'».'»6 


8 


166.03 


138.19 


9 


102.73 


56.99 


II 


3'»8.06 


251.85 


10 


1 '♦05.86 


86'».26 


11 


0.0 


0.0 


10 


3.97 


6.15 


7 


0.0 


0.0 , 


10 


63.32 


27. '♦9 


10 



TABLE 7: COST ESTIMATING RELATIONSHIPS FOR ALL AFSC'S 



MODEL 

1 Trainee Time 

2 Instructor Time 

3 Delayed Entry Time 

k Remedial Training Time 

5 Records Management Time 

6 Tech School Equiv Time 

7 Tech School Delay Time ( 

11 Conditional Trainee Time 

12 Conditional Instructor Time 

1^ Conditional Remedial Training Time 

15 Conditional Records Mgt Time 

16 Conditional Tech School Equiv Time 



MEAN $ 


STD DEV $ 


N 


6'»9.60 


'♦21.'»0 


201 


866.15 


82^1.26 


190 


282.58 


215.52 


226 




37.06 


163 


83.37 


83.21 


186 


108.37 


122. 1»5 


180 


272.93 


20;. 22 


21'» 


1196.29 


90'».i»3 


210 


1 1 1 . 06 


553.30 


221 


12.89 


27.27 


\3k 


7.28 


31.66 


220 


98.3'» 


131.20. 


197 
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management and is based on question 9. Models 3, h and 5 are identi- 
cal to models used in Phase I. They cover three relatively small 
portions of the total cost of training and are based on questions 
which ask for average experience rather than journal recording. The 
magnitude of these est imates— approximately $1»00— is consistent with 
the results in Phase 1. 

Models 6 and 7 relate to the TTS graduate. Model 6 estimates 
the cost of bringing the TTS graduate up to the level of an OJT- 
trained airman, it is based on the average cost per week of training 
(both instructor and trainee) as developed in Models 1 and 2, and is 
an estimate of the average time it takes to bring the TTS graduate 
to an equivalent OJT 3-level. Model 7 is merely the average delay 
awaiting the start of 5-level training for the TTS graduate. Both 
Models 6 and 7 can be thought of as additions to TTS costs to make 
them comparable to OJT costs. 

Perhaps, the more interesting and useful set of models are 11, 
12 l**, 15 and 16. These are the Conditional Models previously 
identified. Using the Conditional Models, trainee costs are about 
$1200 and instructor costs $100. The sum of the average conditional 
model is $300 less than the sum of the first fWe models. 

In other words, using the conditional models implies a higher 
cost of the trainee's time, because the trainees may not contribute 
to productivity, and therefore all the time they are in training {for 
those who don't contribute) is a cost of training, just as it is for 
those in resident technical school. On the other hand in many of the 
training situations, the instructor's time is essentially free, since 
he must be there for other reasons, and in fact has "free" time to 
da the training. On balance, when a more careful analysis of real 
costs is made conditional on the training situations as they 
actually exist, the conditional cost mde\s have a lower average 
cost by about $300.00. 

Table 8 summarizes the results of the models for each AFSC 
for both the basic and conditional models. The numerical results 
show the differences between the conditional and basic models as 
well as the distinct differences between AFSC. it should be pointed 
out, however, that the differences among the costs of OJT in each 
AFSC are primarily a function of the duration of training which is 
derived from historical data from Air Force personnel files. (See 
Appendix III). 

In suimary, the numerical results show no startling differences 
from the 1st Phase. There are differences among AFSC's, as one might 
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TADLE 8: SUMMARY COSTS^ 



AFSC 



SUM OF MODELS 1 TO 5 



SUM OF MODELS H.12.3.IA.IS 





Mean 


Std Dev 


N 


Mean 


Std Dev 


N 


55130 


$2411 


$1324 


21 


$2346 


$1448 


24 


57130 


$1791 


$1159 


16 


$1299 


$ 799 


18 


62230 


$2165 


$1181 


64 


$1941 


$1155 


77 


63130 


$1382 


$ 625 


50 


$1044 


$ 592 


56 


6'»730 


$2264 


$ 438 


7 


$1749 


$1039 


7 


ALL AFSC 


$1916 


$1094 


158 


$1647 


$1120 


182 



These summary costs are derived by averaging the sums of the models 
for each survey; not by adding up the average results for each model. 
This gives a direct estimate of the variance of the sum without 
making any limiting assumptions about independence or covariance. 



ERIC 



Ik 



23 



expect, due primarHy to differences In duration of training, but 
the other results are very similar, for example: 

It takes about 19 weeks to complete 3-'evel proficiency 
training on the average. 

. An OJT trainee spends about 13 hours per week In training, 
and. In many cases, the rest of his work week may not be 
productive work. 

. An Instructor spends about 12 hours per week per trainee, 
but this Is usually not his primary task and a reduction 
in training workload will not typically reduce costs. 

The other elements of cost are relatively small. 

. A TTS graduate has only about 'lO^ of the capability of an 
OJT trained airman when he starts, and It takes him about 
four weeks to make up the difference. 



3. TECHNICAL TRAINING SCHOOL COSTS 

in Phase I. TTS costs were derived from estimates developed 
by RAND Corporation based on a generalized costing methodology which 
included total recurring costs, both fixed and variable. (AlHson. 
1970). In reporting the findings, however, the fixed costs of TTS 
were eliminated to make them more like "marginal costs" and Improve 
the comparability with OJT costs. 

TTS Cost Per Graduate estimates for the AFSC's studied In 
Phase M are displayed in Table 9. Resident Technical Training 
School Cost Estimates. Cost and Economic Analysis Division. Manage- 
ment Analysis Directorate. ATC Comptroller Is the source of the 
costs shown for four of the AFSC's listed In Table 9- Cost Per 
Graduate estimates for AFSC 62230 were not availab e ^-"OIJ^TC and 
were developed by RAND using their costing methodology. This fuwo 
cost estimate reflects only variable cost and not fixed ^^^^^ »" 
addition, it Is appropriate to add the results of Model 6. TTS Equiva 
lency ?l,;e and M^del 7. TTS Delayed Entry Time into Training to the 
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TABLE 9: RESIDtNT TECHNICAL TRAINING SCHOOL COST ESTIMATES 

(DOLLARS) 



Cost Per Delay And Total Cost 

.AFSC_ Graduate Equivalency Costs Per Graduate 

55130 . ii,i,3 i,23 1866 

57130 1879 252 213I 

62230 2920 i»09 3329 

63130 2152 339 2491 

6'i730 1081 i,03 \kSk 
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Cost Per Graduate. These results are also shown in Table 9- 

k, PERFORMANCE OF OJT AND TECH SCHOOL GRADUATES 

The problem of assessing the relative performance of OJT 
graduates versus TTS graduates is indeed complex. Based on the 
Phase I research as well as other research, it was concluded in the 
Phas^ repSr that no evidence had been advanced to support the 
hypothesis that either OJT or TTS graduates were superior to each 
other in performance (see. in particular Dunham 1973). Some 
additional evidence on the perceived performance of the two types 
of rirnt g wafJotlected during Phase II. «e=PO"=«%^° ^rFlc'^s)' 

in superior performance at the 5- level. 
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IV. DISCUSSION OF RESULTS 



Methodology 

During Phase I, three different survey methodologies were 
explored for generating s,jst data, and on the basis of the results 
the Phase 1 1 methodology was developed. This methodology can be 
differentiated from the others tried in Phase I by the following: 

• Use of existing data flies for information on duration of 
training. 

Use of simple questions on average experience where the 
par.:j.T)eters affect cost elements which are relatively small. 

• Use of journal recording by the respondeat supervisor over 

a sample period in order to estimate parameters which affect 
the major cost elements. 

• Use of a survey instrument which is independent of AFSC 

In addition to the above four characteristics, which were 
essentially recommended in the Phase I Final Report, another important 
difference in the methodology was examined. This was the use of 
conditional models which attempted to identify what the actual cost 
consequences of changing the number of trainees or instructors in a 
particular section might be. from actual results obtained from that 
section. 



ine Phase II survey showed that this was not only possible 
but that the conditional models gave substantially different answers 
for the cost of trainee time and instructor time, when compared to 
the basic models which were d*^veloped in Phase I. By coincidence the 
differences were in opposite and offsetting directions so that the 
summary results were not as dramatically different as they might have 
been, but the differences for the cost of instructor time and the 
cost of trainee time were nevertheless substantial. 

The study once again confirmed the ability to get estimates 
of trainee and instructor time by journal recording; that is most 
respondents completed the questions, with what appear to be reasonable 
answers. 

They also appear to have some reliability and consistency 
in terms of comparison to previous studies, and other data in this 
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.;tudv In addition, the response, where trainees were actually 
:Janabll,wasap;ar;ntly very close to total so that non-response 
bias did not seem to be a problem. 

Finally, it was possible to obtain answers about the signi- 
ficance of the time (cost) data being f ^:?^3'":^';"i 
section and therefore to build aggregate conditional models which 
reflect a nore appropriate conceptualization of costs than the 
simpler models used in Phase I. 

Of course, each time a survey instrument is "t'' 
additional improvements to the question phrasing and survey format 
can be Generated. Careful manual editing of each survey was carried 
; wtrHhl obiective of not only assuring the quality of numerical 
re uU t : s^;; fefre? out inadequacies and to make improvements 

in the instrume.nt. A list of these ^Pe^^^i^^«S°™*"tx .r 
attached to the sample instrument provided in Appendix II. 

2. RELATIONSHIPS OF OJT COSTS TO TTS COSTS 

Table lOdisplays the estimated '^^FSC 

also included. 
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TABLE 10: 



COMPARISON OF OJT COSTS AND RESIDENT 
TECHNICAL TRAINING SCHOOL COSTS 
(DOLLARS) PER TRAINEE 



ERIC 



Standard Conditional 
AFSC_ OJT Costs OJT Costs TTS Costs 



55130 2I*\\ 23^6 

57130 1791 1299 

62230 2165 I9i»i 

63130 1382 loAA 

6^730 226A 17^,9 



29130^ 1311 



70230'' 1 sks 



^Dunham, 1972 



''AFHRL-TR-7^-3^ (Phase I Report) 
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1866 

2131 

3329 

2^91 

]m 

2780 

2281 



V 



CONCLUSION 



1. SIGNIFICANCE OF RESULTS 

The most significant finding of the Phase I and Phase II 
results is that it is possible to develop reasonable estimates of 
OJT cost using mail survey techniques. Further, Phase II demonstrated 
that it is possible to refine and improve the techniques so that the 
survey is brief, less costly, easier to implement and AFSC independent. 

As in Phase I and in Dunham's earlier work, the results 
indicate differences between OJT and TTS. Once again it is important 
to caution that the cost differences pointed out will only be the 
consequences of Air Force policy if the Air Force acts in ways w'.iich 
will generate such costs. If, for example, the Air Force sends more 
ODA's to OJT but does not reduce the size of its technical training 
school faculty, then there will be no cost savings. Even the condi- 
tional models in this study, and the cost elements they represent, 
assume that the variable elements of cost will change with the number 
of trainees as a matter of AF management policy. It is also once 
again appropriate to state another caution with respect to the con- 
cept of quality. Neither Dunham's study nor Phase I or 1 1 of this 
study detected real differences in quality between OJT and TTS based 
on supervisor's opinions or other criteria; however, if there were 
important differences, these should affect Air Force decisions. 

2. RECOHHENDATIONS 

The results obtained in Phase II with the five additional 
AFSC's considered, suggest that it is possible to implement a system 
for coll erring cost data by survey for other AFSC's. Whether or not 
this is worthwhile depends, in part, on whether the Air Force is 
prepared to use this information, as well as other data, to allocate 
trainees between OJT and TTS. Note again that this would result in 
lower costs only if: (1) the allocation procedure or model was 
appropriately designed, and (2) the Air Force acted to reduce costs 
consistent with the model's assumptions. 

Thus, the major recommendation of this study is that the Air 
Force begin the collection of cost data on OJT for addltioanl AFSC s 
and additional skill levels using survey techniques similar to those 
developed in Phase li of this study. 
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APPENDIX I 



DESCRIPTIONS OF AFSC'S 

55130; Pavements Maintenance Specialist 

The Pavements Maintenance Specialist will construct, maintain 
and repair pavements and other surface areas, which may include air- 
field mats and membranes, aircraft revetments, railroads, subgrades, 
and drainage structures. He may also perform erosion control 
measures, operate fixed and mobile plants, quarries and borrow pits. 



57I3O; Fire Protection Specialist 

The Fire Protection Specialist extinguishes aerospace vehicle 
and real property fires, rescues personnel, p-events fire and water 
damage, operates firefighting vehicles an* .equipment, r >' forms fire 
protection and prevention duties, operates fire alarm cojnmunication 
systems, and administers first aid. 



62230 : Cook 

The Cook selects, prepares, cooks, arranges, deco-ates and 
serves foods in kitchens, dining halls, aircri^ft, and ip the field, 
correctly utilizing and maintaining equipment anJ 'nsuring that 
sanitation and safety precautions are carried out. 



631 30: Fuel Specialist 

The Fuel Specialist receives, stores, issues, transports, 
samples, inspects, and documents petroleum products and fuels, missile 
propel lants and other special chemicals necessary for the operation 
of aircraft and missiles. He understands the technical characteristics 
of the products, the hazards involved and the precautions necessary 
for their appropriate handling. 



6't730; Materiel Facilities Specialist 

The Materiel Facilities Specialist receives, prepares for 
storage, stores, segregates, inventories, issues, delivers, prepa 
shipments, identifies, inspects and classifies property. 
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Sources: 

„ Specialty Training Standards. Headquarters U. S. Air Force. 

Washington, 0. C. 

551X0 Pavements Maintenance Special i St 2 Dec. 1970 

57130 Fire Protection Specialist 7 May 1970 

^"XO Cook 3, Dec. 1970 

631X0 Fuel specialist 10 July 1970 

647X0 Materiel Facilities Specialist 19 April 1970 
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ncny TO 

ATTN OF PESE (Capt Dirnham, 



4106) 



DEPARTMENT OF THE AIR FORCE 

AFHRL PERSONNEL RESEARCH DIVISION (AFSC) 
UCKLAND AtR FORCE BASE. TEXAS 78236 




suiJECT: OJT Cost Survey 



MAY 3 1 1973 



TO: OJT Supervisors 

1. The purpose of the attached survey (s) is to collect data concerning 
On-the-Job Training to the 3-skill level- This survey data, along with 
information from other sources, will be used in decisions concerning OJT 
and Technical Training School. 

2. Answering the survey questions with some thought and effort will aid 
Air Force decision makers in the management of your AFSC. 

3. Permission to conduct this survey^was granted by Hq USAF/DPXOS, 
reference Air Force Personnel Test (AFPT) Number 80-5X6X-109. 

FOR THE COMMANDER 




1 Atch 
Survey 



Chief, Personnel Research Division 
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INSTRUCTIOr^S jaOJT SUPERVISORS 



The accompanying survey is part of a research effort directed toward 
evaluating the costs ond benefits of "On the Job Training." Your cooperation in 
completing the survey is requested. While it will probably take less than on hour of 
your time, the infonnation you provide will be ver^ valuable to the research and will 
help to improve Air Force policies concerning OJT and Technical Training School. 

If you do not quite understand a question, give the best answer you can and 
feel free to write in an explanatory comment next to the question or on the back of 
the fonn. If you are completely uncertain about what a question means, enter a ''?". 
If a question, for some reason, does not apply to your unit, enter "N.A." 

The survey is divided into two parts: A and B. Part A asks you to try to 
make the best estimates you can about your average experience. 

Part B asb you to keep a record of activities, each day for a week. It is 
important that you do this dail^, so that what was actually done is fresh in everyone's 
mind. If you also feel tJ^the week you reported on is not representative of your 
normal operations, so indicate by writing in an appropriate comment; and if yoo can. 
Indicate what the average value ought to be in your judgment. 

If you have any questions, contact Capt Dunham, Autovon 473-4106. 



' Q Number 



Upgrade Training in AFSC [ J 



SPECIAL INSTRUCTIONS 

1 . The trainee's supervisor should complete this survey. Approximately one half (1/2) 
hour will be required to complete Part A, and five minutes per day for a week will be 
necessary for Part B. 

2. When answering the questions, be sure to have a Job Proficiency Guide (STS) . and 
Consolidated Training Record AF-623 for each person undergoing training, handy to 

refer to. 

3. The person who fills out this survey is encouraged to ask for the help of others, such 
as the OJT Monitor or an instructor when uncertain about the onswer to a question. 

4. Part A which should be completed immediately, is to be returned together with Part 
B within 8 days. Do not start Part B before completing Part A. 

5. If there is difficulty in deciding what information is being asked for in any question, 
contact Capt Dunham, Autovon 473-4106. 



BACKGROUND INFORAAATION 



NAME 

























Lost 





□ 

First Initial 



□ 

Middle Initial 



GRADE If Air Force NCO enter "4" for E4, "5" for E5, etc. 

If Air Force Officer enter "0. " Q 
If Civilian enter last digit of GS GRADE, e.g., "l"forGS.ll. 



SOCIAL SECURITY NUMBER 
PAS CODE ' 
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PART A 



1 . How many trainees do you hove upgrading to the 3 and 5 level in your 
section? 

2. When a man (or woman) first reports directly from Basic Military 
Training, it may take some time before he actually begins training and 
work, even though his "date of entry" to training may be the some as his 
reporting date. This delay may be due to personnel processing, the need to 
wait for security clearance, or some other cause. Approximately how many 
days does it take before the newly arrived "helper"' actually begins OJT? 

3. There is also delay in entering training associated with the arrival of 
a 3 level from Technical School. In addition to personnel processing, 
familiarization with procedures specific to your situation may be necessary 
before he/she actually begins 5 level. training. On the overoge, this delay 
is; 

4. On the average, how many weeks elapse between ochievement of 3 
level proficiency and actual award of the 3 skill level AFSC? 

5. What week of training is your most average 1 level (helper) in? 

6. What % of the 3 level proficiency training do you estimate he has 
completed? 



□ 

3 level 
trainees 



□ 

5 level 
trainees 



8« If you stopped doing OJT training would you be able to reduce the 
number of NCO's in your work area without significantly reducing 
effectiveness? (Insert a "1" for Yes, or a "0" for No). 

9. During the training period for 3 level OJT, the instructor (trainer) 
must spend some time keeping training records up to date. On the 
average over the whole training period, bow many hours (or froctions of 
hout^) per week does the instructor (trainer) spend in record keeping for 
one trainee? 



m 

work days 



m 

work days 







weeks 







7. When he arrived what % of the duties of a 3 level could he complete? | | j 



% 

□ 



Hrs. 
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Port A (cont'd) 



10. The newly arrived Tech School-trained 3 level is not as productive 
at first as the OJT-trained 3 4evel is, although he may soon close the gap, 

0. In your estimate, what percentage of the workload of an OJT- 
trained 3 level can the Tech School graduate handle immediately 
after his arrival? 

b. How many weeks does it take before the Tech School-trained 
3 level works with as little supervision as an OJT-trained 3 level? 

c. After both types of 3 levels are awarded their 5 level, on the 
average do you consider either to have superior performance? 
(Insert a "1" for Yes, or a "0" for No.) 

d. (t your answer was "y-S/ " which type of 3 level do you 
consider to have better perfonnance? (Insert a "1" for OJT, or a 
"O"for Tech School.) 

11. If extra (remedial) training is conducted in your office for trainees 
who fail the End of Course Exam (Apprentice Knowledge Test), answer 
the following questions: 

a. In your experience, what percent of the 3 level trainees fail 
the End of Course Test the first time they take it? 

b. On the average, how many weeks of additional training are 
given to airmen who fail the End of Course Exam before they take 
the test again? 

c . How many hours per week, during the normal work week, does 
the trainee spend engaged in this remedial training? 

d. How many hours per week, during the normal work week, does 
the instructor spend engaged in this remedial training? 

12. If you stopped doing OJT training and had no replacements for the 
trainees could your section continue to perfomi its mission without 
significantly reducing effectiveness? (Insert a "1" for Yes, or a "0" for 
No.) 



Percent 



Weeks 



□ 
□ 



m 

Percent 



Weeks 



Hrs. 



Hrs. 



□ 
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Port A (cont'd) 

13. Bcsed on your post exporience, and, if you feel you need help, the experience of 
other qualified personnel in your section, list the overage number of productive and 
non-productive hours of work for the trainee upgrading to the 3 level for each week 
between start of training and award of skill level . For instance, in the fourth week of 
training your trainee spent approximately 30 hours receiving instruction and reading and 
10 hours doing productive work. Your second entry would look like this: 



/ 



o 



Note that the hours for each week must sum to 40, and you must have an entry in every 
week. If, on the average, trainees ccn^plete training between the 12th and 16th week, 
then the entry for the sixteenth week should show a "40" under productive and a "0" 
under instruction. 



Weeks of Training 
(to the 3-level) 

1 

4 

8 
12 
16 
20 



Trainee Productive 
Hrs Per Week 



Instruction & Reading 
Hrs Per Week 



U..I 



14. What is the total number of personnel in your section (officer, enlisted, 
and civilian)? 

15. In oddttlon to the trainees you now have responsibility for, how many 
more 1 level trainees could your section train right now without 
significantly reducing the effectiveness of section operations? 
(ignoring the limit on authorized number of personnel) 



n 



no. of pers. 

□ 

1 level 
trainees 



16. If you had to lose a qualified 5 level for each new 1 level trainee . — , 

(helper), how many more 1 level trainees could your unit train right now | | 

without significontly reducing the effectiveness of section operations? i level 

trainees 
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PART B 



FOR ONE WEEK PLEASE KEEP A RECORD AT THE END OF EACH DAY OF THE 
AMOUNT OF TIME SPENT IN EACH CATEGORY. 



17. How many DDA airmen do you currently have enrolled in 
OJT to the 3 level? 



□ 

Airmen 



18. Record doily the totol hours your 1 level 
trainees spend on reoding and receiving 
instruction each day. (Be sure and ask your 
trainees for their assistance in completing 
this question). 

19. Record daily the total hours your 1 level 
trainees spend in activities contributing to 
office productivity. 

20. Record daily the total hours of 
instruction provided by each grade of 
instructor. 



Mon 

m 



Tues 



-Ed 



m rxi m m m 



AFTER YOU HAVE COMPLETED THE 
ENTRIES FOR FIVE DAYS RETURN 
THE SURVEY TO YOUR BASE 
CBPO 



Q Number 
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a 


i 


1 1 


1 1 1 


1 1 1 


1 1 1 


E4 


1 


1 1 


f 1 1 


1 1 1 


1 1 1 


ES 


1 1 1 


1 1 


1 1 1 


1 1 1 


1 1 1 


E6 


'—1-1 


ITi 


1 1 1 


ijj 


L.U 


E7 


I 1 1 


LIJ 


I.LI 


I...U 


1 1 1 


E8 


1 1 1 


i 1 1 


1 1 1 


1 1 1 


LU 


E9 


1 1 1 


l.t:j 


1 1 1 


1 1 1 


1 1 1 


GS-5 


i 1 1 


m 


UJ 


UJ 


1 J.J 


GS-6 


1 1 1 




rij 


i.a:i 


i..n 


GS-7 


I...J_! 




1 n 


1 1 1 


1 1 1 


GS-8 


\'T] 


LXl 


LJ.J 


L.1.1 


1 1 1 


GS-9 


LI 1 


1 1 1 


1 1 1 


1 1 1 


1 1 1 






LI 1 


rf 1 


1 1 


1 1 1 



RECOMMENDED REVISIONS TO INSTRUMENT 

The following recommended minor revisions to the Instrument 
result from detailed review and editing of the responses. They 
should be regarded as suggestions for improving future instruments, 
should the Air Force decide to implement the work on a broad scale. 

Question 5 should read ''trainee working toward the 3-IeveP* 
rather than 'M level helper." 

Question 9: The Answer block should have three spaces with a 
decimal, i.e., 

Question 13: Interesting for research purposes but can 
probably be eliminated. 

Questions 15 & '6: (See Question 5). 

Question 17: Should be stated identically to question 1 
or el iminated. 

Question l8 & 19= (See Question 5). 

Question 20: Add ''for trainees working to the 3-level.'* 
Eliminate E-9 through Officer and insert "Other"— use average wage. 

On Page I, Grade: Change instruction to read — If civilian enter 
a "I ." 
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TABLE }} : SUMMARY OF RESPONSES TO QUESTIONS AFSC 55130 



QUESTION 

1.1 Number Upgrading To 3 Level 

1.2 Number Upgrading To 5 Level 

2. Days Delay In Start To 3 Level 

3. Days Delay In Start To 5 Level 
k. Weeks, Proficiency To Award 

5. Week Of Training 

6. Percent Of Training Completed 

7. Percent Of 3 Skill On Arrival 

8. Reduction In NCO's Possible Pet 

9. Record Keeping Hours 

10. 1 Pet Of 3 Skill, Tech Sol Grad 

10.2 Additional Weeks To 3 Level 

10.3 Difference In Training Pet 

10.4 OJT Superior Pet 

11.1 Pet Failing ECT 

11.2 Weeks, Remedial Training 

11.3 Trainee Remedial Hours 

11.4 Instructor Remedial Hours 

12. Effective Without Trainees Pet 

13. Trainee Hrs Productive 



Wk 


Mean 


Std Dev 


N 


1 


18.69 


8.2'» 


29 


k 


20.97 


7.76 


29 


8 


25.03 


5. '♦7 


29 


12 


30.03 


5.63 


29 


16 


35.79 


6.63 


29 


20 


37.07 


5.82 


28 



14. Number Of Personnel In Section 

15. More Trainees Possible 

16. More Trainees Without 5*s 

17. Number Of 3 Level Trainees 

18. Trainee Hrs Training Per Trnee 

19. Trainee Hours Productive 

20.3 Instructor Hrs E3 

20.4 Instructor Hrs E4 

20.5 Instructor Hrs £5 

20.6 Instructor Hrs E6 

20.7 Instructor Hrs E7 

20.8 Instructor Hrs E8 

20.9 Instructor Hrs E9 

20.10 Instructor Hours GS5-GS-9. Off 
Average Instructor Hrs/Trnee 
Average Grade Of Instructor 

Q 35 
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MEAN 


STD DEV 




N 


1.70 


0.91 




27 


2.86 


2.22 




29 


13. '♦3 


8.30 




30 


11.72 


9.09 




29 


7.0'* 


8.13 




26 


12.56 


11.67 




25 


53. '♦6 


32.73 




2k 


23.50 


25.99 




28 


0.20 


0.07 




30 


1.'»7 


1 CI, 
1 .OH 




30 


^♦3.20 


2'».59 




30 


'♦.71 


^♦.56 




28 


0.'»7 


0.09 




30 


0.36 


0.13 






12.19 


\k.(>k 




26 


3.96 


2.31 




26 


9.96 


5. '♦9 




26 


6.60 


'♦.78 




25 


0.53 


0.09 




30 


Trainee 


Hrs Instruction 




Mean 


Std Dev 


N 




21.31 


8.2'» 


29 




19.03 


7.76 


29 




1'».97 


5.'»7 


29 




9.97 


5.63 


29 




^♦.21 


6.63 


29 




2.93 


5.82 


28 




30.67 


20. O** 




30 


3.97 


3.08 




30 


3.10 


2.80 




30 


1.71 


0.90 




28 


14.33 


5.97 




27 


20.80 


9.58 




25 


\k.00 


9.59 




5 


17.00 


18.1'» 




16 


9.13 


^♦.02 




15 


7.90 


9. '♦7 




10 


5.67 


1.15 




3 


0.0 


0.0 




0 


0.0 


0.0 




0 


11.25 


6.18 




l» 


]k.k] 


1'».86 




27 


'♦.92 


1.17 




28 
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TABLE 12: SUMMARY OF RESPONSES TO QUESTIONS AFSC 57130 





oil un 


MrAKI 

ntMw 


d 1 u UcV 


N 


1 1 

1 • 1 


nuniDcr up9'^^oin^ lo j L6VC i 




9 QA 

z. 90 


0/1 
2h 


1 0 

1 « c. 


nuniDer up9iaCjin9 lo y LCvei 


0. 3Z 


0 AC 

3*05 


25 




n^v/ c Ha In C^a»>^ ? 1 1 
Uayb ueiay in OLaiL lO ^ uCVC 1 


c qc 
o.9d 


H. 30 


25 




f^A«# C Ha 1 S«# 1 v% C ^ ^ ^ C i AtJA 1 

Uayb Ueiay In OLaiL lO p UCV6 1 


/.Co 


r 1.7 

5.*»7 


25 




wee Kb f rroi iCfency lo Mwaro 


5.03 


/■ 

H.o3 


23 


>• 


wee K w 1 1 ra i n i 


0. Z 1 




2h 


0* 


rercent ur iratning tonipieteo 


C/ft "71 


0 1 7Q 

21 . /o 


2h 


7 


rercent ur ^ ^Kt i I un Mrrivai 


7 Ql 


I 1 OA 

II . 30 


22 


c 
0* 


Keduction in nlu s rossiolc Pet 


0.0*» 


0.0*» 


25 


Q 

9» 


Record Keeping H6urs 


2. 12 


1 .53 


25 


10 J 


Pet Of 3 Skill. Tech Scl Grad 


45.20 


22.84 


25 


10.2 


Additional Weeks To 3 Level 


3.33 


1.24 


24 




Difference In Training Pet 


0.60 


0.10 


25 


1 A !■ 


OJT Super i or Pet 


0.53 


0.13 


15 


11 1 
11*1 


c^t 17m«. rr*T 

ret ra 1 1 1 ng ECT 


13. 55 


22.30 


20 


11 o 

N • Z 


Weeks, Remed ial Tra ining 


3. HO 


0.99 


23 


11 o 


Trainee Remedial Hours 


11 .87 


7.03 


23 


11 I. 


Instructor Remedial Hours 


7. 17 


5.97 


23 


1 o 


trtective Without Trainees "ct 


0.2*» 


0.09 


25 


13. 


Trainee Hrs Productive 


Trainee 


Hrs Instruction 




Wk nea n S td De v N 


Mean 


Std Dev 


N 




1 loo^ 1AP1 In 

1 12*2o lOol 19 


0 7 7/i 

27. 7h 


10.51 


19 




1 D. DO 10. ZO 19 


23.32 


10.26 


19 




Q nO 00 "7 CA 1 fi 


1 7 7fl 

1 / . /o 


7.50 


18 




19 oH OQ fi Ac 1 /ft 
1 Z ZD* Z^ 0. 0> 1 H 


1 ^ 71 


8.85 


14 




ID ^Z ♦ DH 1 1 ♦ ZU 1 H 


7 7li 


11.20 


14 




OA 0 /i AO 1 1 "70 1 1 

ZU 3h. 03 1 1 . /9 11 


5.9« 


11.79 


11 


1 /ft 


Numoer ur rersonnei in section 




28.40 


24 


1 C 


More Tra tnees ross 1 b le 


9 Qa 

3. oO 


3.58 


25 


1 c 
Id* 


More Trainees Without I> s 


2. 13 


3.27 


24 


1 "7 

17. 


Number Or 3 Level Trainees 


!■ 17 


2.71 


23 


1 0 


Trainee Hrs Training Per Trnee 


1 *». lo 


11.34 


22 




Trainee Hours Productive 


15.23 


10.26 


17 


OA O 

20. 3 


Instructor Hrs E3 


7.00 


6.68 


4 


9A /ft 


instructor nrs t*t 


11 C7' 


8.17 


14 


20.5 


Instructor Hrs E5 


11.18 


12.85 


17 


20.6 


Instructor Hrs E6 


11. H 


7.80 


9 


20.7 


Instructor Hrs E7 


5.00 


0.0 


I 


20.8 


Instructor Hrs E8 


4.00 


0.0 


1 


20.9 


Instructor Hrs E9 


2.00 


0.0 


1 


20. )0 


Instructor Hours GS-5-GS-9, Off 


15.38 


13.73 


8 




Average Instructor Hrs/Trnee 


S.96 


9.02 


20 




Average Grade Of Instructor 


5.32 


1.01 


21 
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TABLE 13: SUMMARY OF RESPONSES TO QUESTIONS AFSC 62230 



QUEST I ON 

1.1 Number Upgrading To 3 Level 

1.2 Nunber Upgrading To 5 Level 

2. Days Delay In Start To 3 Level 

3. Days Delay In Start To 5 Level 

4. Weeks, Proficiency To Award 
5^ Week Of Training 

6. Percent Of Training Completed 

7. . Percent Of 3 Skill On Arrival 

5. Reduction In NCO's possible Pet 
9. Record Keeping Hours 

10.1 Pet Of 3 Skill, Tech Scl Grad 

10.2 Additional, Weeks To 3 Level 

10.3 Difference In Training Pet 

10. ^ OJT Superior Pet 
n.l Pet Failing ECT 

n.2 Weeks, Remedial Training 

11.3 Trainee Remedial Hours 

11. ^ Instructor Remedial Hours 

12. Effective Without ^rainees Pet 



MEAN 


STD OEV 


N 




2.03 


86 


' • ^ ^ 


2.87 


84 


13* 56 


9.35 


88 


12.89 


9.58 


83 


5. '♦I 


5.07 


87 


11 ,95 


7.92 


77 


56*63 


28.33 


81 




19.36 


85 


0 08 


0«03 


86 


2.28 


1.76 


87 




20.52 


84 


4. 54 


2.H 


82 


0.71 


0.05 


82 


0.51 


0.07 


57 


21.09 


22.29 


82 


k.si 


2.i»9 


84 


6.96 




83 


5. '♦8 


3.88 


83 




0.05 


87 



13. 





Trainee Hrs 


Product ive 




Wk 


Mean 


Std Dev 


N 


I 


18.07 


11.03 


82 


4 


21.00 


8.50 


81 


8 


25.16 


7.96 


81 


12 


29.23 


8.00 


79 


16 


32.65 


8.34 


79 


20 


35.35 


8.17 


79 



Trainee Hrs Instruction 



14. 

15. 

16. 

17. 

18. 

19. 

20.3 

20.4 

20.5 
20.6 
20.7 
20.8 

20.9 
20. 10 



Number Of Personnel In Section 
More Trainees Possible 
More Trainees Without 5's 
Number Of 3 Level Trainees 
Trainee Hrs Training Per Trnee 
Trainee Hours Productive 
Instructor Hrs E3 



Instructor 
Instructor 
Instructor 
Instructor 
Instructor 
Instruc tor 
Instructor 



Hrs 
Hrs 
Hrs 
Hrs 
Hrs 
Hrs 



E4 

E5 
E6 
E7 
E8 
E9 



Hours GS5-GS-9, Off 
Average Instructor Hrs/Trnee 
Average Grade Of Instructor 



Mean 


Std Dev 


N 




21.93 


11.03 


82 




19.00 


8.50 


81 




14.84 


7.96 


81 




10.77 


8.00 


79 




7.35 


8.34 


79 




4.65 


8.17 


79 




40.34 


24.18 




87 


3.82 


2.84 




87 


1.92 


2.22 




89 


2.39 


1.74 




83 


11.34 


5.98 




81 


20.05 


10.85 




66 


11.38 


8.94 




21 


11.05 


8.19 




41 


11.02 


11.01 




59 


5.50 


4.32 




28 


3.45 


1.51 




11 


2.00 


0.0 




1 


3.00 


0.0 




1 


6.67 


5.57 




9 


12.06 


10. 10 




73 


4.73 


0.71 




73 
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TABLE 14: SUMMARY OF RESPONSES TO QUESTIONS AFSC 63130 



QUESTION 

Kl Number Upgrading To 3 Level 

1*2 Number Upgrading to 5 Level 

2. Days Delay In Start To 3 Level 

3. Days Delay In Start To 5 Level 
Weeks, Proficiency To Award 

5* Week Of Training 

6. Percent Of Training Completed 

7. Percent Of 3 Skill On Arrival 

8. Reduction In NCO's Possible Pet 
9* Record Keeping Hours 

10. 1 Pet Of 3 Skill, Tech Scl Grad 

10.2 Additional Weeks To 3 Level 

10.3 Difference In Training Pet 

10.4 OJT Superior I Pet 

11.1 Pet Fail ing ECT 

11.2 Weeks, Remedial Training 

11.3 Trainee Remedial Hours 

11.4 Instructor Remedial iJours 

12. Effective Without Trainees Pet 

13. Trainee Hrs Productive 



Uk 


Mean 


Std Dev 


N 


I 


12.58 


9.69 


66 


4 


18.28 


8.22 


67 


8 


24.07 


7.34 


67 


12 


28.37 


8.07 


67 


16 


33.29 


8.70 


66 


20 


37.17 


6.72 


63 



14. Number Of Personnel In Section 
15* More Trainees Possible 
16. More Trainees Without 5's 
17* Number Of 3 Level Trainees 

18. Trainee Hrs Training Per Trnee 

19. Trainee Hours Productive 

20.3 Instructor Hrs E3 

20.4 Instructor Hrs E^ 

20.5 Instructor Hrs E5 

20.6 Instructor Hrs e6 

20.7 Instructor Hrs E7 

20.8 Instructor Hrs e8 

20.9 Instructor Hrs E9 

20.10 Instructor Hours GS-5-GS9, Off 
Average Instructor Hrs/Trnee 
Average Grade Of Instructor 
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MEAN 


STD DEV 




N 


2.44 


1.66 




70 


3.95 


2.87 




62 


12.19 


10.34 




72 


10.40 


7.18 




67 


6.13 


6.16 




70 


10.82 


6.45 




66 


61.99 


26.08 




68 


12.25 


14.47 




69 


0.19 


0.05 




72 


2.33 


1.76 




72 




«. 




7'* 


4.14 


3.13 




74 


0.54 


0.06 




72 


0.56 


0.08 




39 


19.41 


25.36 




63 


3.98 


2.78 




65 


9.06 


5.08 




66 


7.81 


4.66 




64 


0.26 


0.05 




72 


Trainee 


Hrs Instruction 




Mean 


Std Dev 


N 




27.42 


9.69 


66 




21.72 


8.22 


67 




15.93 


7.34 


67 




11.63 


8.07 


67 




6.71 


8.70 


66 




2.83 


6.72 


63 




47.34 


30.21 




70 


3.99 


3.20 




69 


2.06 


2.85 




70 


2.23 


1.47 




60 


13.79 


7.45 




60 


21.21 


10.03 




57 


5.54 


2.47 




13 


11.18 


6.97 




39 


11.64 


10.35 




45 


8.48 


6.28 




21 


13.50 


13.44 




2 


0.0 


0.0 




0 


0.0 


0.0 




0 


7.33 


. 2.31 




3 


11.90 


8.59 




59 


4.87 


1.10 




60 
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TABLE 15: SUMMARY OF RESPONSES TO QUESTIONS AFSC SkJiO 



QUESTION 

IJ Number Upgrading To 3 Level 

I. 2 Number Upgrading To 5 Level 

2. Days Delay In Start To 3 Level 

3. Days Delay In Start To 5 Level 

4. Weeks, Proficiency To Award 
5- Week Of Training 

6. Percent Of Training Completed 

7- Percent Of 3 Skill On Arrival 

8. Reduction In NCO's Possible Pet 

9. Record Keeping Hours 

10. 1 Pet Of 3 Skill, Tech Scl Grad 

10.2 Additional Weeks To 3 Level 

10.3 Difference In Training Pet 
\0.k OJT Superior Pet 
n.I Pet Failing ECT 

II. 2 Weeks, Remedial Training 
11.3 Trainee Remedial Hours 
W.k Instructor Remedial Hours 

12. Effective Without Trainees Pet 

13. Trainee Hrs Productive 



Wk 


Mean 


Std Dev 


N 


1 


11.00 


6.99 


10 


k 


18.00 


k.22 


10 


8 


27.00 


k.22 


10 


12 


32.kS 


7.16 


11 


16 


37.00 


k.22 


10 


20 


33. kk 


1.67 


9 



]k. Number Of Personnel In Section 

15. More Trainees Possible 

16. More Trainees Without 5's 

17. Number Of 3 Level Trainees 

18. Trainee Hrs Training Per Trnee 

19. Trainee Hrs Productive 
20.3 Instructor Hrs E3 

20. Instructor Hrs Ek 

20.5 Instructor Hrs E5 

20.6 Instructor Hrs E6 

20.7 Instructor Hrs E7 

20.8 Instructor Hrs E8 

20.9 Instructor Hrs E9 

20.10 Instructor Hours GS5-6S9, Off. 
Average Instructor Hrs/Trnee 
Average Grade Of Instructor 



MEAN 


STD DEV 


N 


l.^tO 


0.70 


10 


2.00 


\.kS 


10 


13.91 


\2.h2 


1 1 


1'».60 


10.56 


10 


5.6i» 


5.33 


1 1 


i». ir 


2.k7 


9 


38.13 


31.03 


8 




22.00 


9 


0.0 


0.0 


10 


2.67 


1.66 


9 




21 .66 


1 1 


3.6i» 


1.21 


11 


OAS 


0.15 


11 


oM 


0.22 


5 


20.13 


20.39 


8 


3.50 


0.53 


8 


5.63 


1.77 


8 


5.13 


2.17 


8 


0.36 


0.15 


11 


Trainee 


Hrs Instruction 


Mean 


Std Dev 


N 


29.00 


6.99 


10 


22.00 


^♦.22 


10 


13.00 


'».22 


10 


7.55 


7.16 


11 


3.00 


1».22 


10 


0.56 


1.67 


9 


17.27 


11.33 


11 


2.18 


1.60 


11 


1.36 


1.03 


11 


1.36 


0.67 


11 


13.73 


8.03 


11 


' 20.36 


10.92 


11 


6.50 


2.12 


2 


8.00 


2.78 


8 


, 7.88 


^♦.29 


8 


7.25 


1.50 


It 


2.00 


0.0 


I 


2.00 


0.0 


I 


0.0 


0.0 


0 


5.00 


0.0 


1 


13.11 


7.19 


11 


k.7k 


0.55 


11 
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NOTES TO TABLES 11 THROUGH 15 



The ''STD DEV is "S," a maximum likelihood estimate of the 
''Universe Standard Deviation" derived from the sample. A confidence 
limit on the sample mean would be derived from the "Standard Error 
of the Mean": S//7. N is the number of valid responses. (Blanks 
are not counted) . 

Questions 8, 10. 3» 10.4 and I2» are dichotomous variables 
with the results expressed as a proportion, (e.g., 0.3^ " 3^ per cent) 
Thus the mean is a fraction and the standard deviation is /p q/n 
which Is the ''Standard Error of the Mean'* for the Binomial 
Distribution. 
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DISCUSSION OF RESPONSES TO QUESTIONS 



Question 1 yields the number of trainees in a section 
upgrading to the 3 level. As was previously suggested for the five 
AFSC's the average number of trainees was much greater than in 
AFSC 70230 studied in the first Phase. Note, however, that the 

, range of averages for the five AFSC's was from \.k^ in AFSC 6^730 

' to 4.33 in AFSC 57130. 

Questions 3 to 7 show no surprises and very little differences 
from Phase I. It is assumed that at any point in time there is a 
uniform distribution of time in training (Questions 5 and 6) and on 
the average it takes about 22 weeks to complete training. Results in 
AFSC's 64730 and 55130 would indicate shorter duration for these 
AFSC's, however, actual training duration data derived from AFHRL 
files (shown at the end of Appendix IV), donot confirm this; and it 
is likely that the samples in those two AFSC's are small enough so 
that bias (of unknown source) may be a problem. 

Question k is critical in estimating duration, since the data 
in Air Force files provide dates encompassing the inception of 
training to the award of AFSC. In OJT this award may come several 
weeks after OJT proficiency has been achieved and OJT to the 3 
level completed. 

Questions 8 and 12 are both new and interesting. The results 
of Question 8 suggest that only 13% of the supervisors felt it was 
possible to reduce the number of NCO's if OJT were stopped. Question 
12 implies that only 36* of the sections could perform their mission 
effectively without trainees. These questions provided the basis for 
the conditional models, and their impact on the cost results has 
already been discussed. 

Question 13 displays the change in amount of time spent on 
training over the training period and essentially confirms the theory 
suggested in Phase I— namely, that the time spent in training does 
drop off substantially.- 

Question \k indicates the size of the sections sampled and 
shows the range of averages for each AFSC— from 17 in AFSC 6^*730 
to 65 in AFSC 57130. 

Questions 15 and 16 suggest additional capacity to train 
without an increase in costs, which is another way of stating the 
result of Question 8. The NCO's work is not primarily training. He 
needs to be there for other reasons and the capacity to train is 
built in. 

The hours spent in training per week. Question 17, is on the 
average, about thirteen, which is also just about half-way down the 
trend indicated by Question 13* 



APPENDIX IV 
COST MODELS 



GENERAL TERMS 
Constants 

WE2 through WE 15 - wages/hour 
WE 2 - WE 9 • wages for E2 - E9 
WE 10 - WE 1 4 - wages for GS-5 - 6S-9 
WE 13 » wages for 2nd Lt. 

F. » Average time from entry to training to award 
of AFSC (in weeks) for kth AFSC, 



Notation 

8 is the constant "8" 

8. means the answer to question '•8," 

8J. means the answer to question ••8.i.** where i 
goes from 1 to n 

>*|>* IS the cxKiditlonal : that is 

C - WE2 ik.) I 5.1. « I 

means Cost - WE2 (answer to question k) given 
the answer to question 5.1 is I. 
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MULTIPLE USE TEfWS 



The following terms are repeated several times in the models 
and for convenience are identified symbolically: 



• Sum of Instructor Hrs/Wk 

15 grades 5 days 

SI - I I (20.i.j) 

i-3 j-1 



• Weighted sum of Instructor Cost/Wk (Instructor Hrs x Wages) 

15 grades 5 days 
WSI - ^ [ WEi (20. I. j) 

i-3 j-1 



• Duration of Training 



Average time from entry to training to 
award of AFSC (in weeks) for the kth 
AFSC less time from proficiency to award 



0 - (F^ - k.) 
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BASIC MODELS 



MODEL 1 - TRAINEE TIME COST 

5 days 

TTC - (Trnee wages/hr.) I (trnee hrs/day)/no. of trnees) (duration) 

i«l 

5 

Ml - (WE2) I (I8.i./17.) (D) 
l«l 

MODEL 2 - INSTRUCTOR TIME COST 

ITC - (Weighted Sum of Instructor Cost Wk)/(no. of trnees) (durat ion) 
M2 - (WSI/17.)(D) 

MODEL 3 - DELAYED ENTRY TIME COST 

DETC - (Trainee wages/day) (delay in entry to 3 level training) 
M3 - (WE2)(8)(2.) 

MODEL k - REMEDIAL TRAINING TIME COST 

RTTC » (Average wage/instructor hr) ( instructor hrs remedial tmg) + 
(trainee wages/hr) (trainee hrs/wk remedial training) times 
(Wks, remedial training) (Pet failing ECT) 

H^ ' (WSl/SI)(ll.d.) + (WE2)(ll.c.)(ll.b.)(ll.a./100) 
MODEL 5 - RECORDS MANAGEMENT TIME COST 

RMTC » (Average Wage/Instructor hr.)(rcrd kpng hrs/wk) (durat ion)/no. of 
M5 = (WSI/SI)(9.)(D)/17. 
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HODEL 6 - TTS EQUIVALENCY TIME COST 

TETC « {(Wks to equivalency) (I -Percent capabi I i ty)/2} 

(Average cost for trainee and instructor time/wk) 
M6 « {(l0.b.)(l-IO.a./100)/2} (Ml + M2)/D 

MODEL 7 - TTS DELAY TIME COST 

TDTC = (Trainee wages/day) (days delay) 

M7 -WE3(8)(3.) 
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CONDITIONAL COST MODELS 



MODEL 11 - CONDITIONAL TRAINEE TIME COST 

CTTC » Model 1 if trainee contributes to productivity 

CTTC = (Trainee wages/hr) (AO) (duration) if trainee does not 
contribute to productivity 

Mil = Ml I (12.) - 0 

Mil = (WE2)(i»0)(D) I (12.) = 1 

MODEL 12 - CONDITIONAL INSTRUCTOR TIME COST 

CITC = Model 2 If NCO's can be reduced if training stops 

CITC = 0 if NCO's cannot be reduced 

M12 = M2 I (8.) = 1 

M12 = 0 I (8.) = 0 
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MODEL ]k - CONDITIONAL REMEDIAL TRAINING TIME COST 

CRTTC = Model '-» if trainee contributes to productivity and NCO's 
can be reduced 

CRTTC « (Average wage of Instructor) (Instructor hrs remedial trng) 
(wks, remedial trng)(Pct falling ECT) If trainee does not 
contribute to productivity and NCO's can be reduced^ 

CRTTC . (trainee wages/hr) (tra inee hrs remedial training) 

(wks, remedial training) (Pet failing ECT) if trainee 
contributes to productivity and NCO's cannot be reduced 

CRTTC - 0 if the trainees do not contribute to productivity and 
NCO's cannot be reduced 

- Mi. I (12.) - 0, (8.) = 1 

H\k = (WSI/Sl)(ll.d.)(l|.b.)(|l.a./IOO) i (12.) = 1, (8.) » 1 
MIA = (WE2) (ll.c.)(ll.b.)(ll.a./IOO) | (12.) - 0, (8.) - 0 

- ° J (12.) . 1, (8.) - 0 

MODEL 15 - CONDITIONAL RECORDS MANAGEMENT TIME COST 
CRMTC = Model 5 If NCO's can be reduced 
CRMTC - 0 If NCO's cannot be reduced 
M15 - M5 I (8.) . 1 
MI5 = 0 I (8.) = 0 

MODEL 16 - CONDITIONAL TECH SCHOOL EQUIVALENCY TIME COST 

CTETC - (Wks to equivalency) (1 - Percent capabi I lty/2) 

(conditional costs for trainee and Instructor time) 

MI6 » {(10. b.) (l-l0.a./I00)/2} 



3Note: trainee cost In this case Is Included In Model 11. 
(Condition: (12.) » 1) * 
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INTERMEDIATE OUTPUT MODELS 



MODELS 31-32 - ACTIVITY PER WEEK/TRAINEE 



X _Y_ 
T8" 31 
19 32 



APWT = \ Activity/Day/Trainee 



M(Y) - I Xi./17. 
i-l 



MODELS 


33-39 


- ACTIVITY PER WEEK 






5 


X 


Y 


APW = I Activity/Day 


20.3 


33 


i=l 


20. 


3k 




20.5 


35 


5 


20.6 


36 


M(Y) - I Xi. 


20.7 


37 


i=l 


20.8 


38 




20.9 


39 




MODEL 


I.A 


ACTIVITY PER WEEK/GRADE 



15 5 

?rades days 
I (Activity /day) /No. of grades 

i=lO j=l 



MODEL k] 



15 5 
HkO = I ^20. i.j/N 
i=IO j=I 



INSTRUCTOR HRS/TRAINEE 



15 5 

?rades days 
I (Instructor hrs/no. of trainees) 

i=3 j-1 



M*1 - SI/17. 
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MODEL k2 - AVERAGE GRADE OF INSTRUCTOR 
15 5 

?rades days 
I (Instrctr hrs for ith grade) (instrctr grd)/(total Inst hrs) 

15 5 
grades days 
M'*' - A I 20.i.j.(G)' * 

1=3 J=l 



•♦For E-3 to E-9, G = 3 to 9—For GS.5 to GS-9 G = 5 to 9- 

For Officer G = 10. 
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SUMMARY MODELS 



MODEL 20 - SUM OF OJT COST 

M20 - Mj + Mg + M3 + M^ + Mg 

MODEL 21 - CONDITIONAL 
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VALUES OF CONSTANTS 



F,^ DURATION OF TRAINING IN WEEKS 

k MEAN S. 0. N 

55130 26. li* 12.88 229 

57130 21.50 9.01 i»56 

62230 26.79 11.77 527 

63130 16.68 7.\k Qsk 

6'»730 2i».68 10.78 869 



WE HOURLY WAGES 



2 


2.85 


10 


^♦.03 


3 


2.98 


11 


'♦.53 


k 


3. '♦6 


12 


5.03 


5 


'♦.13 


13 


5.57 


6 


'♦■.88 


U 


6.1i» 


7 


5.52 


15 


5.05 


8 


6.20 






9 


7.16 
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